Sketch-specific data augmentation for freehand sketch recognition

نویسندگان

چکیده

Sketch recognition remains a significant challenge due to the limited training data and substantial intra-class variance of freehand sketches for same object. Conventional methods this task often rely on availability temporal order sketch strokes, additional cues acquired from different modalities supervised augmentation datasets with real images, which also limit applicability feasibility these in scenarios. In paper, we propose novel sketch-specific (SSDA) method that leverages quantity quality automatically. From aspect quantity, introduce Bezier pivot based deformation (BPD) strategy enrich data. Towards improvement, present mean stroke reconstruction (MSR) approach generate set types smaller variances. Both solutions are unrestricted any multi-source sketches. Furthermore, show some recent deep convolutional neural network models trained generic classes images can be better choices than most elaborate architectures designed explicitly recognition. As SSDA integrated networks, it has distinct advantage over existing methods. Our extensive experimental evaluations demonstrate proposed achieves state-of-the-art results (84.27%) TU-Berlin dataset, outperforming human performance by remarkable 11.17% increase. Finally, more experiments practical value our sketch-based image retrieval.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Freehand Sketch Recognition Using Deep Features

Freehand sketches often contain sparse visual detail. In spite of the sparsity, they are easily and consistently recognized by humans across cultures, languages and age groups. Therefore, analyzing such sparse sketches can aid our understanding of the neurocognitive processes involved in visual representation and recognition. In the recent past, Convolutional Neural Networks (CNNs) have emerged...

متن کامل

Sketch-Based Mesh Augmentation

This paper describes a sketch-based method for augmenting geometric meshes with variable-scale sharp features. Such mesh editing operations provide a powerful way to exploit artist’s natural sketching abilities for content creation using existing mesh libraries. We use adaptive subdivision to refine the mesh only in the region of the features and embed the augmentations into the input mesh, mai...

متن کامل

3d Modeling of Trees from Freehand Sketch

We present an interface for quickly and easily modeling 3D trees from freehand sketch. The system generates a 3D geometry from 2D sketch on the basis of our observation that trees spread their branches uniformly. Our system also supports several interfaces for editing the 3D tree by drawing additional strokes. These editing operations include adding a branch, cutting a branch and erasing a bran...

متن کامل

Human motion retrieval based on freehand sketch

In this paper, we present an integrated framework of human motion retrievalbased on freehand sketch. With some simple rules, the user can acquire a desired motion by sketching several key postures. To retrieve efficiently and accurately by sketch, the 3D postures are projected onto several 2D planes. The limb direction feature is proposed to represent the input sketch and the projected-postures...

متن کامل

Title: Combining Sketch Representations for Improved Recognition Title: Combining Sketch Representations for Improved Recognition Title: Combining Sketch Representations for Improved Recognition Title: Combining Sketch Representations for Improved Recognition

Brief Statement of the Problem: Sketching is a common means of conveying, representing, and preserving information , and it has become a subject of research as a method for human-computer interaction , specifically in the area of computer-aided design. Digitally collected sketches contain both spatial and temporal information; additionally, they may contain a conceptual structure of shapes and ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2021

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2020.05.124